ON THE IDENTIFICATION OF THE GROUND STATE BASED ON 
OCCUPATION PROBABILITIES: 
AN INVESTIGATION OF SMITH'S APPARENT COUNTEREXAMPLES 



TIEN D. KIEU 

Abstract. We study a set of truncated matrices, given by Smith in connection to an 
identification criterion for the ground state in our proposed quantum adiabatic algorithm for 
Hilbert's tenth problem. We identify the origin of the trouble for this truncated example and 
show that for a suitable choice of some parameter it can always be removed. We also argue 
that it is only an artefact of the truncation of the underlying Hilbert spaces, through showing 
its sensitivity to different boundary conditions available for such a truncation. It is maintained 
that the criterion, in general, should be applicable provided certain conditions are satisfied. We 
also point out that, apart from this one, other criteria serving the same identification purpose 
may also be available. 



In a proposal of a quantum adiabatic algorithm for Hilbert's tenth problem [5], we employ an 
adiabatic process with a timc-dcpcndcnt Hamiltonian 

(1) m = {l-tlT)Hi + {t/T)Hp. 

Here t is time and this Hamiltonian metamorphoses from Hi when t = to Hp when t = T. The 
final Hamiltonian Hp encodes the Diophantine equation in consideration, while the initial Hi is 
universal and independent of the Diophantine equation, except only on its number of variables K. 
The process is captured by the Schrodinger equation 

(2) dtm)) = -^m\m). 

\m) = 

where |{a}) is the ground state of the initial infinite-dimensional Hamiltonian Hi, which we choose 
to be 

K 

(3) Hi = ^(at-a*)K-aO. 

i=l 

This choice is not unique, but with it, \{a}) is then the Cartesian product, of K factors, of the 
well-known coherent states in quantum physics. 

In order to identify the ground state at the final time t ~ T, wc have shown in the case of 
2-dimensional spaces that if we could choose a such that |('0(O)|{^})I^ < 0.5, for all \{n}) 
which are the Pock states and also the eigenstates of Hp, then 

(4) If (V'(r)|{n(°)}) % i ^ |{"*°^}> is the ground state of Hp, 

assuming such a ground state is non-degenerate, and provided an extra condition has to be satisfied, 
for all < t < r, namely 

(5) {e{t)\Hp - Hi\g{t)) ^ 0, 
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where \g{t)) and \e{t)) are, respectively, the instantaneous ground state and the first excited state 
of Sj{t) at the time t. The violation of that condition at some to is equivalent to 

(6) Both (e{to)\Hp\gito)) = 0, 

(7) And {e{to)\Hi\g{to)) - 0. 

In two dimensions this criterion for the ground-state identification can easily and always be 
satisfied for Hj and Hp noncommutting, which is automatic for our choice of Hj. For higher 
dimensions, the non-commutativity of the Hamiltonians is no longer a sufficient condition for (jSJ. 
And we need make sure that the condition (jSJ is observed. 

Recently, Smith has claimed to have three counterexamples [Hj against the criterion above. 
Of the three provided, actually there is only one that is relevant and fits the form of our time- 
dependent Hamiltonian |^ in the case of one variable, but truncated to five dimensions and with 
the diagonal term (1 — added to 
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Smith has chosen the particular values a — \ and T = 13.3444. In this note we shall only 
investigate this example; other criticisms by Smith in ;8; also overlap with others', our replies to 
which have been given in 0. 

Indeed, when we solve the Schrodinger equation ||2J), starting with the exact ground state of i/^, 
we obtain at time t = no Fock-statc occupation probabilities is more than 0.5, but at i = T, the 
first excited Fock state has a probability of 0.999323 - apparently contradicting the criterion Q). 
We have depicted the occupation probabilities of the instantaneous ground and first excited states 
as functions of time in Fig. ^ At first, the ground-state occupation is close to one, as it should 
be because we start the system in the initial ground state. Then, suddenly at around t 10 this 
probability plummets to zero, accompanying by a stellar rise of that of the first excited state. 

A closer inspection of spectral fiow (the fiow of eigenvalues of S^{t) as functions of time) reveals 
a singular behaviour of the flow also around i w 10, namely, that of an avoided crossing of the 
instantaneous ground and first excited state as shown in Figs. |21 and O 

As a matter of fact, all these anomalous behaviours arc caused by the violation of the condi- 
tion (O , or equivalently, by the realisation of lO and Q , as shown by the simultaneous vanishing 
of the three matrix elements, see Fig.01 around (but a bit earlier than) the time of the anomalous 
transfer of probability from the ground state to the first excited state. 

Appropriately large values for a. Surely, for that value of a = 1 one could increase T and 
eventually will have an arbitrarily high occupation probability of the final ground state, as guar- 
anteed by the quantum adiabatic theorem. However, for the present value of T = 13.3444 we can 
avoid the violation of (O, and thus restore the criterion Q), by widening the gap between the 
instantaneous ground and first excited states. This can be achieved by choosing an appropriately 
large value for the parameter a. In Fig.jSjwe plot the occupation probabilities of the instantaneous 
ground and first excited states as functions of a. It is seen that as long as a > 2 our identification 
criterion Q is again valid. We present further results for a = 3, as an example, in Figs. El U\ 
andlHl None of those shows any anomalous behaviour. (We also plot the ground state occupation 
for a = 3 (filled black circles) in Fig. for comparison with the case a = 1.) 

We have provided some arguments in to indicate that the condition (jSJ can always be 
obtained for sufficiently large values of \a\. The larger this value is, the more dominant role Hj 
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Figure 1. The occupation probabilities of the instantaneous ground state (un- 
filled boxes) and first excited state (triangles) as functions of time, for a = 1. 
The excited-state probability rises suddenly from near zero to close to one around 
t w 10, which corresponds to the near miss of these two energy levels as shown 
in Fig. 121 The filled circles are for the instantaneous ground-state occupation for 
a = 3, which shows no sudden change. See text for further explanation. 
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Figure 2. The spectral flow for a = 1. The apparent crossing of the lowest two 
energy levels just after t «:! 10 is actually an avoided crossing as shown in Fig. 01 



has in Sj{t), such that the lowest branch of the spectral flow (that is, the branch of the ground 
state) would be straightened out as the case in Fig. [TJ and any avoided crossing as the one in 
Figs. 12 and 121 could not be formed. 

How could one estimate such a value for \a\7 One possible procedure is: 
• We firstly choose a value for a and use the criterion Q to obtain a candidate state, say \m). 
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Figure 3. An avoided crossing for the lowest two energy levels for a = 1. Note 
the large variations in the first derivatives of the branches. 
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Figure 4. The sudden change in occupation probabilities in Fig. ^ at certain 
time io is due to the simultaneous vanishing, at exactly the same time (and a 
bit earlier than to), of the three different matrix elements in Q, © and lO - 
respectively corresponding to the (red) dash line, the (green) dash-dot line, and 
the (blue) long dash-dot line. 



• Then the diagonal term (to| jo(t)|m) is of the form 

(9) (1 -i/T)(m-h lap) 4- (t/r)(m|i?p|m). 

If we choose a. such that the first term in (j^ dominates over the second term, for some t close 
to T, then Hi would dominates over Hp for this state and at this time. As a result, no avoided 
crossing (which is due to the influence of Hp) could be formed at this late and thus could never 
be formed. A repeat of the adiabatic process and another application of the criterion would 
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Figure 5. The final occupation probabilities for the ground state (red boxes) 
and first excited state (green triangles) at T = 13.3444 for different values of a's. 
As expected, the true ground state dominates for larger a. 
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Figure 6. The occupation probability of the instantaneous ground state as a 
function of time, for T = 13.3444 but with a = 3. (Note that the vertical scale 
does not go down to zero.) 



then reveal if the candidate |m) is the true ground state. Otherwise, a different candidate would 
be obtained and we could repeat the whole procedure of choosing a again. 



Sensitivity with different boundary conditions for the truncation. In general, we suspect 
that the possibility of the violation of lO is an artefact of the truncation of the Fock space since it 
is extremely sensitive to the truncation and its associated boundary conditions. Note also that any 
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Figure 7. The spectral flow shows no anomalous behaviour for a — 3. 
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Figure 8. The probabilities, for a — 3, for different Fock states as functions of 
the final time T. There is only one state that has a probability eventually rising 
above 0.5 (red boxes) and that is the true ground state of Hp, namely |4). 



truncation would distort the spacings between the eigenvalues of iJ/, severely away from unity par- 
ticularly near the truncation. In Smith's truncation to five dimensions, for example, the four spac- 
ings between the eigenvalues of Hf are 1.11927, 1.40986, 1.84784, and 2.54043, respectively from 
the lowest to the highest eigenvalues, which are (0.0114457,1.13072,2.54058,4.38841,6.92885). 
That is, the spacing between the fourth and fifth eigenvalues near the truncation is 2.54043, which 
should have been one. This and the fact that the ground state of Hp happens to be right at the 
truncation, |n) = |5), make the problem very sensitive to boundary effects. 

However, the addition of extra states or the imposition of (anti)-pcriodic boundary conditions 
on the truncated spaces may remove the violation of (0) , as shown below. 
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Figure 9. The spectral flow for a ~ 1, with periodic condition for the truncated 
Fock space. 




1 2 3 4 5 

T 



Figure 10. The final occupation probabilities for different Fock states at the 
final time T for a = I but with periodic condition for the truncated Fock space. 
The boxes represent the true final ground state |4). 

In obtaining the truncated matrices Smith has implicitly imposed the boundary condition 

(10) a'f |4) = 0; a|0) = 0, 

on the underlying truncated Fock space. However, other boundary conditions can also be imposed 
on an equal footing, for example, 

(11) at |4) = ±V5 |0); a |0) = ±^5 |4), 

where the plus (minus) sign corresponds to periodic (anti-periodic) boundary condition on a Fock 
space having only five vectors, {|0), |1), |2), |3), |4)}. With these new (anti)-periodic boundary 
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Figure 12. The final occupation probabilities for different Fock states at the 
final time T for a = 1 but with anti-periodic condition for the truncated Fock 
space. The boxes represent the true final ground state |4). 



conditions, we would have 
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with ata|0) = 5|0), while assuming that Hp maintains the same form. Figs. El EH and IT^ 
show the non-anomalous and drastically different behaviour, as compared to 0, for the same 
parameters a = 1 and T = 13.3444. 

Based on such sensitivity and some other evidence, we suspect that a violation of ^ or, 
equivalently, a realisation of ((BJ and ((TJ could not be attained either for very large or an infinite 
number of dimensions, or for more than one variable. It is perhaps appropriate to mention here 
that all the numerical simulations presented in [21 have been obtained not with truncations with 
rigid boundary as the cases Smith has considered but with movable boundaries where more Fock 
states are included when and if necessary. Results from further analytic investigations for an 
infinite number of dimensions would be reported elsewhere when they become available^. 

We should note further that may not be the only means which can be used to identify the 
final ground state. A more general one, as discussed in ^EI, could be a matching of the statistics 
of the measurement outcomes of a physical quantum adiabatic process (in a space of presumably 
infinite dimensions) with those of a numerical simulation of the process with a necessarily truncated 
space. As the size of the truncation is enlarged, the true final ground state would eventually be 
included in such a truncated Fock space. From then on, further enlargement of the truncated 
Fock space only serves to improve the precision of the statistics comparison. (This is another 
manifestation of the finitely refutable nature of our problem, as mentioned in [HI.) 

Finally, we also would like to point out that in addition to the physical process discussed here, 
which is governed by the linear Schrddinger equation^ we can also map Hilbert's tenth problem 
into a class of non-linear differential equations that is readily available to pure mathematical 

investigation. 
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^They are now available in |7| with a result confirming that, indeed, the condition can be violated neither 
in infinite dimensions, nor in a finite number of dimensions with suitable boundary conditions, such as the (anti)- 
periodic boundary conditions 1111 . 



